Psychometric validation of the Laval developmental benchmarks scale for family medicine

Abstract Background With the implementation of competency-based education in family medicine, there is a need for summative end-of-rotation assessments that are criterion-referenced rather than normative. Laval University’s residency program therefore developed Developmental Benchmarks Scale Family Medicine (DBS-FM), based on competency milestones. This psychometric validation study investigates its internal structure and relation to another variable, two sources validity evidence. Methods We used assessment data from cohort residents ( n = 1432 assessments) Rasch Rating Model investigate reliability, dimensionality, rating scale functioning, targeting items residents’ levels, biases (differential item functioning), hierarchy (adequacy milestones ordering), score responsiveness. Convergent was estimated by correlation with clinical rotation decision (pass, difficulty/fail). Results The DBS-FM can be considered as unidimensional good reliability non-extreme scores (.83). between expected empirical hierarchies .78, p < .0001.Year 2 achieved higher year 1 residents. It associated decision. Conclusion Advancing validation, this found has sound demonstrates convergent validity.